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Abstract. We extend the Jarzynski equality, which is an exact identity between the 
equilibrium and nonequilibrium averages, to be useful to compute the value of the entropy 
difference by changing the Hamiltonian. To derive our result, we introduce artificial dynamics 
where the instantaneous value of the energy can be arbitrarily controlled during a nonequilibrium 
process. We establish an exact identity on such a process corresponding to the so-called 
Jarzynski equality. It is suggested that our formulation is valuable in a practical application as 
in optimization problems. 



1. Introduction 

To decrease the power loss, we often design the shortest paths to connect with each components 
in electric integrated circuits. Not only the electric loss but also any kinds of the cost are 
demanded to be minimized as far as possible in industrial products. Such problems can be 
formulated into a more generic task to minimize or maximize a real single-valued function of 
multivariables, which is called optimization problems [U [2]. Several solvers for optimization 
problems have been invented in the context of the dynamical process in statistical physics OS]. 
In these methods, the system is driven to be trapped at the global minimum of the complicated 
valley structure. 

In the present study, we approach this issue in a non-standard way with the recent progress in 
statistical mechanics. We propose a method to measure the difference between the approximate 
result given by solvers of optimization problems and the true answer. In practice, we do not 
always know the ground state energy, however the minimum value of the entropy is known 
trivially. Therefore the entropy can be an indicator for the deviation of the approximate solution 
from the accurate answer. 

To goal of our study, we extend the identity proposed by Adib, which is useful to estimate 
the entropy difference in changing the Hamiltonian in artificial dynamics [5]. This identity 
is inspired by the Jarzynski equality, which plays a key role to connect equilibrium states at 
beginning and end with a nonequilibrium process [6]. However the original formulation given by 
Adib is considered only for the isoenergy process, on which the energy is fixed to be a constant 
value, while the Hamiltonian changing. We extend the identity of the entropy difference in the 
isoenergy process to an energy-controlled process [7]. 



2. Formulation 

In order to arbitrarily control the energy, we introduce an artificial field F = (F^Fp) to the 
Hamilton dynamics. The equations of the modified dynamics are 

x = ^ + F,(r), p = -— + Fp (r). (i) 

The above T = (x, p) describes a point on the phase space. The energy follows an arbitrary 
function of time E(t), while the Hamiltonian changing from t = to r, if we choose the functional 
form of F = (F x , F p ) as 

Here X is an arbitrary vector on the phase space satisfying X • drH ^ 0. 

^From equations (Q} and ([2]), we can easily confirm that the energy is accurately controlled 
as E(t) since we have 

dH _ dH . dH _ dE 

It ~ df ' + ~dt ~ dT ( ' 

Under the special dynamics ([T]), the ensemble density pt(T) evolves following the Liouville 
equation: 

Pt (T t ) = Po (T )e- t ^\ (4) 

where 

T t (T t ) = j fdt'A(T t ,). (5) 
t Jo 

Equation ([5]) is the time average of the "phase space compression factor" A(r^) = dr t ■ Tt along 
the trajectory that connects Tq to Tt [8\. This factor appearing in the dynamics of the ensemble 
density pt(Xt) will play the central role to estimate the entropy as shown below. Similarly to the 
original Jarzynski equality, the system is assumed to be in an equilibrium state at the initial time 
t = 0. The distribution po(To) at the initial time is set to be the microcanonical distribution at 
E = E{0): 

6(H(T ) - E(0)) 

Po(T ) = 7z , (6) 
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where f^o is the number of states at t = 0. 

Let us consider the average of e TAr over all possible realizations from t = to r: 

(e^> = /dr rfr( r T yg = /dr / (fl(r °); m) . (7) 

In the second transformation, equations and ([6]) have been used. Note that we control the 
energy of the system as H(Tt) = E(t), and we thus find 

H{T t ) - E(t) = H (T ) - E(0) (8) 

for any t G [0, r]. Therefore H(Tq) — E{0) in the Dirac delta function of equation ([7]) can be 
replaced by H(T T ) — E(t). Equation ([7]) can be reduced to 

(e rS7 ) = e As . (9) 

Above AS = ln($7 T /^o) is the entropy difference between the equilibrium states at the different 
energy values E(0) and E(r). Therefore we can obtain the entropy difference after the 
nonequilibrium procedure following the schedule of the energy E(t). If we estimate the entropy 
difference with such a naive method as directly calculating the entropy at the initial and final 
times, we have to investigate the entropy twice. On the other hand, our formula ([9]) gives the 
entropy difference by taking just a single average ofe rAT . This means that we can examine the 
entropy difference by the direct use of the resulting ensemble after the nonequilibrium process. 



3. Application to optimization problems 

We here show that our equality can be used for a quantitative estimation, which indicates 
how much an approximate solution differs from the true solution. Let us consider an arbitrary 
potential energy V(x) with continuous variables x which has no degeneracy at the ground state, 
and assume that a solution with the energy £ has been obtained. We consider the following 
Hamiltonian 



At the first stage of the dynamics, the system can visit all the locations since the potential 
energy is small. By increasing the coefficient of the potential energy, the particle can recognize 
the energy barriers and be trapped into local minima. Let us consider the schedule of the 
energy from E(0) = £' to E(t) = £, where £' > £. The entropy at the initial time S(0) can be 
calculated easily since the system equals to non-interacting particles with the mass m = 1/2 at 
t = 0. On the other hand, the entropy at the final time S(t) = S(0) + AS can be estimated by 
calculating AS from our identity. 

The detailed protocol is described below. First, we randomly choose an initial condition 
(xo,po) from the set {(x, p)\H(x,p;t = 0) = £'}. Note that the initial Hamiltonian depends 
only on p. We obtain the path toward a phase point with the lower energy following the energy- 
controlled dynamics ([1]) under the given initial condition. Some initial conditions result in the 
divergence of the factor appearing on the right-hand side of equation ([2]) when the system is 
trapped in a local minimum with dr t H = 0. Such a divergence means that the energy can not 
decrease toward £ and the system evolving from such initial conditions are unable to reach any 
points on the phase space at t = r. Therefore such samples should be excluded in taking the 
average of expTA r . Finally, we take the average of exprA T only in the case of the absence of 
such divergences, and we obtain AS appearing on the right-hand side of our equality (|9|). 

In the case of optimization problems, the value of the energy at the ground state cannot be 
known in advance. On the other hand, the minimum value of the entropy is trivial as — oo in the 
case of classical systems. Therefore S(t) — > — oo implies that the obtained solutions after the 
nonequilibrium process for the given potential energy are close to the minimum point. In other 
words, estimating the difference of the entropy can be an indicator how much the approximate 
solution differs from the actual minimum. 

The detailed estimation by use of a simple instance is given in the reference [7]. Let us here 
emphasize another advantage in use of the entropy difference to measure the deviation from the 
true solution. As described in figure 1, if AE = £2 — £\ takes a common value in both case, 
the entropy gap AS" can become quite different, since the entropy rapidly decreases when the 
system breaks through local minima of the potential energy. The energy cannot lead us to any 
information on the difference coming from the energy structure. Therefore the entropy difference 
can be a good measure of the deviation from the true solution in optimization problems. 
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Figure 1. Case that equal AE but different AS. 



4. Conclusion 

We have extended the Adib identity inspired by the Jarzynski equality to an energy-controlled 
system, and shown the possibility as the measure of the deviation of the approximate solution 
from the true answer. However our study is still short of consideration, since the efficient 
dynamics to search for the ground state have not considered. In addition we have trouble in 
numerical computation, since the value of the entropy of an approximate solution is compared 
with an infinite value in our protocol. To solve these problems, we might establish the quantum 
version of our identity. In the case of a quantum system, the entropy at the ground state is 
equal to which is clearly more suitable for the quantitative estimation than — oo of classical 
systems. Furthermore, the tunneling effect can be useful, as quantum annealing, for searching 
for the global minimum of the complicated energy landscape as in spin glasses, with which most 
of the optimization problems are closely related [9]- 

We also remark that the quantum version of our formulation can also open the possibility 
of quantum computation. By use of the quantum degrees of freedom, we can implement our 
identity in the quantum computation [10]. The same techniques as in the literature would be 
available to suggest the algorithm to estimate the entropy as well as the free energy. 
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